Human Factors and Design Issues in Multimodal (Speech/Gesture) Interface
نویسندگان
چکیده
Multimodal interfaces are the emerging technology that offers expressive, transparent, efficient, robust, and mobile human-computer interaction. In this paper, we described the speech/gesture based multimodal interface systematically from the human factors point of view. To design more practical and efficient multimodal interface, human factors issues such as user modeling, usability studies, speech and gesture interaction/integration, and redundancy are discussed. This paper can be helpful to the researchers in the field of study that enhances the performance of multimodal interaction.
منابع مشابه
Multimodal Human-Computer Interaction for Crisis Management Systems
* Corresponding author. Abstract This paper presents a multimodal crisis management system (XISM). It employs processing of natural gesture and speech commands elicited by a user to efficiently manage complex dynamic emergency scenarios on a large display. The developed prototype system demonstrates the means of incorporating unconstrained free-hand gestures and speech in a real-time interactiv...
متن کاملMultimodal interfaces: Challenges and perspectives
The development of interfaces has been a technology-driven process. However, the newly developed multimodal interfaces are using recognition-based technologies that must interpret human-speech, gesture, gaze, movement patterns, and other behavioral cues. As a result, the interface design requires a human-centered approach. In this paper we review the major approaches to multimodal Human Compute...
متن کاملDecoupling of Modality Integration and Interaction Design for Multimodal Human-Robot Interfaces
The development of a multimodal Human-Robot Interface (HRI) involving mixed-initiative and context-awareness is complex and laborious. The integration of individual modalities (e.g., gesture recognition or speech output) and the design of natural human-robot interaction are two different tasks that both require their own expertise. In this paper, we consider three different roles that participa...
متن کاملSpeech-Gesture Driven Multimodal Interfaces for Crisis Management
Emergency response requires strategic assessment of risks, decisions, and communications that are timecritical while requiring teams of individuals to have fast access to large volumes of complex information and technologies that enables tightly coordinated work. The access to this information by crisis management (CM) teams in emergency operations centers can be facilitated through various hum...
متن کاملFrom a Wizard of Oz experiment to a real time speech and gesture multimodal interface
This paper describes a Wizard of Oz cooperative story telling experiment named Virstory, where user speech-gesture actions are interpreted in order to cooperatively build a story with another person, partner of the interpreter. The gesture, speech and multimodal behaviours of 20 subjects are detailed. The Multimodal Oral With Gesture Large display Interface (MOWGLI) is then described. It is an ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- JDCTA
دوره 2 شماره
صفحات -
تاریخ انتشار 2008